Birmingham
Benchmarking Tabular Foundation Models for Conditional Density Estimation in Regression
Izbicki, Rafael, Rodrigues, Pedro L. C.
Conditional density estimation (CDE) - recovering the full conditional distribution of a response given tabular covariates - is essential in settings with heteroscedasticity, multimodality, or asymmetric uncertainty. Recent tabular foundation models, such as TabPFN and TabICL, naturally produce predictive distributions, but their effectiveness as general-purpose CDE methods has not been systematically evaluated, unlike their performance for point prediction, which is well studied. We benchmark three tabular foundation model variants against a diverse set of parametric, tree-based, and neural CDE baselines on 39 real-world datasets, across training sizes from 50 to 20,000, using six metrics covering density accuracy, calibration, and computation time. Across all sample sizes, foundation models achieve the best CDE loss, log-likelihood, and CRPS on the large majority of datasets tested. Calibration is competitive at small sample sizes but, for some metrics and datasets, lags behind task-specific neural baselines at larger sample sizes, suggesting that post-hoc recalibration may be a valuable complement. In a photometric redshift case study using SDSS DR18, TabPFN exposed to 50,000 training galaxies outperforms all baselines trained on the full 500,000-galaxy dataset. Taken together, these results establish tabular foundation models as strong off-the-shelf conditional density estimators.
- Europe > France > Auvergne-Rhône-Alpes > Isère > Grenoble (0.04)
- South America > Brazil (0.04)
- North America > United States > New York (0.04)
- (2 more...)
Major leap towards reanimation after death as mammal's brain preserved
Major leap towards reanimation after death as mammal's brain preserved A pig's brain has been frozen with its cellular activity locked in place and minimal damage. Could our brains one day be preserved in a way that locks in our thoughts, feelings and perceptions? An entire mammalian brain has been successfully preserved using a technique that will now be offered to people who are terminally ill. The intention is to preserve all the neural information thought necessary to one day reconstruct the mind of the person it once belonged to. "They would need to donate their brain and body for scientific research," says Borys Wróbel at Nectome in San Francisco, California, a research company focused on memory preservation.
- North America > United States > California > San Francisco County > San Francisco (0.55)
- North America > United States > Oregon (0.05)
- North America > United States > California > San Bernardino County > Fontana (0.05)
- Europe > United Kingdom > England > West Midlands > Birmingham (0.05)
- Asia > China > Guangdong Province > Shenzhen (0.04)
- North America > United States > California > Santa Clara County > Palo Alto (0.04)
- North America > United States > New Jersey > Hudson County > Hoboken (0.04)
- (5 more...)
- North America > United States > California > San Francisco County > San Francisco (0.14)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Europe > United Kingdom > England > West Midlands > Birmingham (0.04)
- Europe > Germany (0.04)
- Transportation > Air (0.68)
- Leisure & Entertainment > Games (0.47)
- North America > United States (0.04)
- Europe > United Kingdom > England > West Midlands > Birmingham (0.04)
- Europe > United Kingdom > England > Greater London > London (0.04)
Switching Temporary Teachers for Semi-Supervised Semantic Segmentation
The teacher-student framework, prevalent in semi-supervised semantic segmentation, mainly employs the exponential moving average (EMA) to update a single teacher's weights based on the student's. However, EMA updates raise a problem in that the weights of the teacher and student are getting coupled, causing a potential performance bottleneck. Furthermore, this problem may become more severe when training with more complicated labels such as segmentation masks but with few annotated data. This paper introduces Dual Teacher, a simple yet effective approach that employs dual temporary teachers aiming to alleviate the coupling problem for the student.
- Europe > Switzerland > Zürich > Zürich (0.14)
- Europe > Netherlands > North Holland > Amsterdam (0.04)
- Europe > United Kingdom > England > West Midlands > Birmingham (0.04)
- Europe > Austria > Vienna (0.14)
- North America > United States > New York > New York County > New York City (0.04)
- Europe > United Kingdom > England > West Midlands > Coventry (0.04)
- (8 more...)
- Asia > China > Guangdong Province > Shenzhen (0.04)
- Europe > United Kingdom > England > West Midlands > Birmingham (0.04)
- Asia > Middle East > Jordan (0.04)
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.15)
- Europe > United Kingdom > England > West Midlands > Birmingham (0.04)
- Europe > Portugal > Braga > Braga (0.04)
- North America > United States > California > Los Angeles County > Long Beach (0.05)
- North America > United States > Washington > King County > Bellevue (0.04)
- North America > United States > Virginia > Fairfax County > Fairfax (0.04)
- (2 more...)